Skip to content

Add support to mine cargo Package-URLs#679

Merged
AyanSinhaMahapatra merged 13 commits into
aboutcode-org:mainfrom
ziadhany:min-cargo
Sep 29, 2025
Merged

Add support to mine cargo Package-URLs#679
AyanSinhaMahapatra merged 13 commits into
aboutcode-org:mainfrom
ziadhany:min-cargo

Conversation

@ziadhany

@ziadhany ziadhany commented Sep 3, 2025

Copy link
Copy Markdown
Collaborator

@ziadhany ziadhany force-pushed the min-cargo branch 2 times, most recently from 5cdc47b to ae60ff2 Compare September 4, 2025 23:13

@AyanSinhaMahapatra AyanSinhaMahapatra left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @ziadhany, looks good as a start. Please see my comments for your consideration

Comment thread minecode_pipelines/pipelines/mine_cargo.py Outdated
Comment thread minecode_pipelines/pipes/__init__.py Outdated
Comment thread minecode_pipelines/miners/cargo.py Outdated
Comment thread minecode_pipelines/miners/cargo.py Outdated
@pombredanne

Copy link
Copy Markdown
Member

@ziadhany what's left todo here?

@ziadhany

Copy link
Copy Markdown
Collaborator Author

@pombredanne I just need to use the common function. But I already tested running the workflow in this repo: https://github.com/ziadhany/cargo-test/. I will update it today.

Comment thread minecode_pipelines/pipes/__init__.py Outdated
Comment thread minecode_pipelines/pipes/__init__.py Outdated

@AyanSinhaMahapatra AyanSinhaMahapatra left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @ziadhany, looking good.
See my comments for your consideration. We can also start testing this in the aboutcode-data CI now

Comment thread minecode_pipelines/miners/cargo.py Outdated
Comment thread minecode_pipelines/miners/cargo.py Outdated
Comment thread minecode_pipelines/miners/cargo.py
Comment thread minecode_pipelines/miners/cargo.py Outdated
Comment thread minecode_pipelines/pipelines/mine_cargo.py Outdated

DATA_DIR = Path(__file__).parent.parent / "test_data" / "cargo"


Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A bit more tests for cargo mining would be nice, we can create a small repo with some commits to test, this is okay

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @ziadhany, looks good. Could you use these repositories instead:

And run this using the CI action added at aboutcode-data/minecode-pipelines-config#1?

The issue can be closed with this ^
Merging the PR as everything looks good otherwise.

Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Refactor code to be compatible with the new pipeline.

Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Add logging and fix bug in process_cargo_packages

Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Fix bug in process_cargo_packages.

Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
@AyanSinhaMahapatra AyanSinhaMahapatra merged commit e389935 into aboutcode-org:main Sep 29, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants